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Summary. To make clear several issues relating with the thermodynamics of computa- 
tions, we perform a simulation of a binary device using a Langevin equation. Based on 



> 

fN| , our numerical results, we consider how to estimate thermodynamic entropy of computa- 

tional devices. We then argue against the existence of the so-called residual entropy in 
q ■ frozen systems such as ice. 
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1. INTRODUCTION 

How much energy must be used in a computation? Landauer [1] answered to 
this question in 1961 as follows: 

"Logical irreversibility implies physical irreversibility" (p. 186 in Ref. [1]) and 
requires a finite amount of heat generation. A data-erasing operation is generally 
irreversible and induces the heat generation, which corresponds to a cost of energy, 
^ ■ fcTln2/bit (at least), while a reversible operation such as copying can be free of 

any cost of energy. 

It seems that Landauer's theory has been accepted widely since then [2,3]. Re- 
cently, however, Goto et al. disputed it and claimed that it is possible to erase in- 
formation without producing heat generation by using Quantum Flux Parametron 
devices [4] . The controversy has lead us to a recognition of several problems which 
relate to the thermodynamics of computations and are still left unclear: 
During the computational processes, 
ql. when does the heat generation occur? 
q2. when is the energy consumed? 

q3. when does the entropy increase (and when does it decrease)? 
q4. how should the thermodynamic entropy of computational devices be defined? 
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2. DATA-ERASING OPERATION 



Let us consider a binary device which consists of a bistable potential well and 
a particle in it. When the particle is in the left (right)-hand well, we assign state 
"0" ("1") to the device. Following Landauer, we define a data-erasing operation, 
RTO (Restore To One) which resets the device on state "1" regardless of the initial 
state. In order to erase the information, one must carry out the operation RTO 
without knowing whether the device is initially in state "0" or "1". This can be 
done by the following processes: 

u 2 - u, - u ± + u 3 - u 2 + u 3 - u 2 , m 

(i) (ii) (iii) (iv) (v) 

where Ui ( i — 1, 2, 3 ) are defined as 
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• Single- well potential : Ui(x) = 

• Double- well potential : U 2 (x) — ^ - ^f- + 

• Bias potential : U 3 (x) = —Bx. 

Corresponding to the initial state "0" or "1", an RTO operation is expressed as 
in Fig. 1(a) or 2(b), respectively. We have introduced the "neutral" state, "n" 
which was not described explicitly by Landauer. The states "1" and "0" will be 
called also the "memory" state, "m". The RTO operation is then expressed as a 
combination of two processes 

(A) (i) -> (ii) : Erase "1" or (A') (i') -> (ii) : Erase "0", 

(B) (ii) -> (iii) -> (iv) -> (v) : Record "1". 

Process (B) can be reversible, whereas (A) and (A') are irreversible because the 
information has been erased in state "n" . 

Simulating the above processes, we shall answer to questions ql ~ q4 addressed 
in the previous section. 



Fig. 1. RTO operation, (a) (A) + (B). (b) (A') + (B). 



3. SIMULATION OF A BINARY DEVICE 

We consider a particle in a time- dependent potential described as the following 
Langevin equation: 

mx = - 1 x-^^ + R(t). (2) 
ox 

The random force R(t) is a white Gaussian noise satisfying 

(R(t)R(t')) = 2 7 A;T, (3) 

where T is the temperature of the environment. 

For example, the process (i) — > (ii) in expression (1) which accompanies the 
change of the potential from U(x, ti) = U 2 (x) to U(x,ti +Ti) = U\(x) is described 

as 

u{Xit) = El_--(t-tM X \{"-(t-h)A}\ (4) 

where "switch-on" function a + (t) and "switch-off" function a_(t) are defined by 

^( 1= Fl), ^<0> 
a±(t) = { -(l=Fcos[7rt/ri],) 0<t<Ti, (5) 

Similarly, the process (ii) — > (iii) in expression (1) can be carried out by changing 
the potential as 

x 4 

U(x,t) = — -a+(t-t 2 )Bx. (6) 
The heat generation during a time interval t in the environment is given by 

Q(t) = f ( 7 i - R(t')) xdt' . (7) 
Jo 

The energy consumption, i.e., the work done by an external agent is [5] 

When a process is reversible, the entropy of the device changes by the amount 

AS = -f, (9) 

corresponding to the heat generation Q in the environment. 

Integrating eq. (2) numerically, we can estimate the heat generation, the energy 
consumption and the entropy change in each process of computations. 



4. NUMERICAL RESULTS AND 
THERMODYNAMIC AL CONSIDERATION 



We simulated processes (B) + (A) under a constant temperature. In order for 
the system to come thermal equilibrium, the potential was kept constant for a time 
interval T before and after every procedure of changing potential (which takes 
a time Ti, see eq. (5)). Parameters are fixed as A = 7.0, B = 4.0, 7 = 4.0 
and To = 100. m, k and T are chosen as unity. For the computer not to work 
erroneously, it is important that the central hill of U2(x), A 2 / '4, must be high 
enough in comparison with the thermal energy kT so that the particle in state "m" 
can never jump over the hill during an ordinary time scale of computations. 

After one cycle (B) + (A), both the net work, W, done on the device by the agent 
(= the energy consumption) and the net heat generation, Q, in the environment 
turned out to be almost equal. That is consistent with the energy conservation 
because the device returns to the initial state after one cycle. 

The processes should tend to be quasi-static as Ti increases. We examined Ti- 
dependence of W and Q and found that both approach to ~ £Tm2 = 0.693/cT 
(after one cycle) as Ti — > 00. This result confirms Landauer's conclusion. 

Let us see in detail what happens in each process to answer to questions ql ~ q4. 
In Table 1, numbers in lines 1) and 2) are results of our simulation, whereas lines 

3) ~ 7) are derived from these results based on thermodynamical consideration. 
Line 5) represents a net entropy change of the device, which is the sum of 3) and 

4) , the former is the entropy change corresponding to the heat generation and the 
latter is the entropy production. The entropy production is nonzero only in the 
irreversible deleting process (A). Line 6) is the entropy change in the environment, 
which directly relates to the heat generation Q. 

Table 1 explicitly answers to questions ql ~ q3. The point is that the energy 
is consumed and the heat is generated in the reversible writing process, while the 
entropy production occurs in the irreversible deleting process. 

Question q4 is answered from the following postulates: 

(I) The entropy S m of a recorded state "m" (m = 1 or 0) should be estimated 
from a half of volume of the region in the phase space, i.e., < x < 00 for "1". 
This corresponds to the fact that state "m" is non-ergodic. 

(II) For a deleting process ("1"— >"n" or "0"— »"n"), the entropy change of the 
device is the sum of two terms, one is —Q&/T corresponding to the heat generation 
(in the environment) and the other is an extra increase of entropy, A; In 2. Namely, 



The above postulates are in accordance with the present simulation as we will 
show below. We use the general expression for entropy: 




Q d /T + k In 2. 



(10) 



S n - S m = {{E) n - (E)J /T + kki [Z n /Z m ] . 



(11) 



The first term, arising from the energy difference, is estimated from quadrature as 



TABLE 1. The heat generation Q, the work W and the entropy change AS in each 
process. "D" and "E" stand for the device and environment, respectively. "T" stands for 
the total system: "D" + "E". 1) and 2) are results of the simulation. Each value is the 
sample average for 100 independent runs. T\ = 1000. For other parameters, see the text. 





(B) reversible 
Recording "1" 


(A) irreversible 
Deleting "1" 


(B) + (A) 
One cycle 




Q in "E" 


Q r = 1.07 * 


Q d = -0.36 ** 


0.71 


1) 


W done on "D" 


W r = 1.35 o 


W d = -0.64 oo 


0.71 


2) 


"D" 


AS 

corresponding to Q 


-Qr/T = -1.07 


-O d /T = 0.36 


-0.71 


3) 


entropy 
production 


(reversible) 


0.71 


0.71 


4) 


AS 

= 3) + 4) 


Si — S n = —Q r /T 
= -1.07 f 


S n - Si = 1.07 


S n -S n = 


5) 


"E" 


AS 

corresponding to Q 


Qr/T = 1.07 


Qd/T = -0.36 


0.71 


6) 


"T" 


= 5) + 6) 


(reversible) 


0.71 


0.71 


7) 



((E) n - (E)J IT = fc/4 - 0.519A; = -0.269, (12) 

where U\(x) and U2(x) are substituted for the potential. We apply Postulate (I) 
to estimate the ratio of the partition functions as 

/OO POO 
e- u ^' kT dx/ / e- u ^' kT dx. (13) 
-oo JO 

Note that the lower limit of the integral in Z m is x = instead of — oo. The second 
term of eq. (11) is thus obtained as A; In [Z n /Z m ] = 1.325, which yields 

S n - S m = 1.056. (14) 

Process (B) is reversible, so that the heat generation is given by Q r = T (S n — S m ) 
= 1.056, which agrees well with the simulation (see mark * in Table 1). From 
the energy conservation, the work is obtained from eqs. (12) and (13) as W r = 
- ((E) n - (E) m ) +Q r = 1.325, to be compared with mark o in Table 1. 

Next we apply Postulate (II) for the irreversible process (A). Then we obtain 
from eqs. (10) and (14) as Qd — —T (S Q — S m ) + A;Tln2 = —0.363. The work is, 
again from the energy conservation, W& = ((E) n — (E) m ) + Qd = —0.632. These 
values agree well with the results of the simulation (** and oo in Table 1). 

5. CONCLUSIONS AND OPEN QUESTIONS 

We have simulated process (A): "1"— >"n". The same results for Qd and in 
Table 1 should be achieved for process (A'): "0"— >"n" because of the symmetry 



of the potential. Also recording "0" i.e., process (B'): "n"^"0" yields the same 
results for Q T and W T as (B) 1 . The entropy in state "0" is therefore equal to that 
in "1". In contrast, the entropy in the deleted state "n" is larger as shown in Table 
1 or eq. (14). 

Now, let us consider a computer composed of N binary devices. After a series of 
computations, each device realizes state "1" or "0" at random as 

0,1, 0,1, 1,0, 1,0, 0,1, 0,1,1, •••(). (15) 

Applying RTO on each device in the above, we obtain 

1,1, 1,1,1,1, 1,1,1,1, 1,1,1,---1. (16) 

Devices may be in "1" or "0" before RTO and are definitely in "1" after RTO, but 
the entropies before and after RTO are the same in each device. If the entropy is 
an additive quantity, which we admit, the random state (15) has the same entropy 
as the ordered state (16). This is one of our conclusions. 

It has been widely believed that randomness contributes to entropy. If so, state 
(15) would have Nk\n2 larger entropy than (16). Our conclusion contradicts with 
this traditional view. The contradiction stems from non-ergodicity of the computer 
devices. Even though each device after computations seems to have taken "1" or "0" 
randomly, the particles in state "1" can never jump into the side "0" . Otherwise the 
computer may make errors! Exactly the same situation, we believe, occurs in frozen 
systems like ice. If the temperature is low enough, each proton in the ice cannot 
jump over the potential hill between two oxygen atoms. Thus the system is non- 
ergodic and the entropy is the same as the ordered state although the configuration 
of N protons is completely random. Therefore we claim that the residual entropy 
Nk In 2 does not exist in the ice despite of the 2 Ar -fold degeneracy. This is another 
conclusion of ours. 

Are our conclusions wrong? We hope not! At least we could say that there 
are several unsettled problems in thermodynamics when non-ergodic systems like 
computers are involved, which were not so important in Boltzmann's time. 
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^ Furthermore, the order of processes does not affect these results. For example, (B) after (A) 
will lead to the same Q r and W r as (B) before (A). 
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